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ABSTRACT 

Several tenets of mastery learning were examined in 
this study in the context of college level instruction. When students 
learn for mastery; (1) retention test scores should exhibit small 
variability and should be unrelated to aptitude; (2) test items which 
are classified into high and low cognitive behavior subscales should 
be unrelated to aptitude. The first tenet was partially supported as 
the relationship between retention and aptitude was uniformly low 
across three units of instruction, and variability of retention tests 
was not restricted. No relationship between performance on both high 
and low cognitive subscales and aptitude was observed. (Author) 



EFFECTS OF LEAIUJIUI VARIABILIS OM RETISNTIOIJ AND TWO LEVELS OF 
COGIMTIVS IIATKUIAL WHEH LEARUINO FOR MASTERY 

Michael S. Riviere and Thomas H. Haladyna 
Southern Illinois University at Carbondale 

Although there are many examples of nastery learning in 
operation at present, the basic principles utilized have been 
expressed and examined following the llodel o£ School Learning 
proposed by Carroll (1963) and have incorporated in the 
strategies proposed by Bloom (1968). Mastery learning is 
purported to allow for high levels of performance from students 
regardless of measured aptitude (lUoclc, 1971). That is to say, 
most students can attain a hiph level of achievement in the class 
room if mastery learnins is employed, regardless of the students' 
prior academic achievement or performance on aptitude teats. 
Furthermore, it can be argued that if students are normally 
distributed with respect to aptitude for a particular subject 
natter prior to instruction, nearly all students under a mastery 
system will perform at a level normally attained by a relatively 
small number of students in a nonmastery class in rrhlch the 
traditional group-paced, norm-referenced procedures are euployed. 

Several studies have reported findings based on comparisons 
between mastery and nonmastery instructional groups, Mastery 
groups have Generally attained hishor levels of achievement and 
typically express a more favorable attitude toward learninp, under 
the mastery learning 8tratep,y (Kim, 1971} :ic :lchael & Coroy, 1969 
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Sheppard & MacDermott. X970). Sjogren (1967) examined the tendency 
of mastery students to retain instructional material as a result 
of mastery learning, yot. he did not analyse retention scores 
across measured aptitude levels for the sample of students employed. 
A distribution of retention scores for such a group of mastery 
learners would necessarily approach a mal distribution if 
aptitude were a potent vatiable. In fact, only iltnited research 
has been conducted enarilnlnr' the influence of aptitude upon 
retention of instructional material in a classroom learning 
enviornment. This research offers little assistance in the under- 
standing of the effects of specific Instructional sequences such 
as Mastery Learning or PS2 (Personalized Student Instruction) 
on retention when a uniformly hi|>h decree of learning was 
demonstrated. 

The issue concerning the relationship between aptitude and 
retention nust also be examined in light of the cognitive level 
of the material presented. The ability of students to learn and 
retain instructional material may be related differentially according 
to the cognitive complexity of the material, -hile only a few 
studies deal with the cognitive complexity of the learnln, tasks 
in a mastery based setting, these studies may provide the basis 
for an alternate theory of student performance under such learning 
paradigms. Oagnc and Paradise (1961) reported a study In which 
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learning rates and aptitude were studied, finding that aptitude 
in fact predicted rate of learnin« and that the acquisition of 
low-level congnitive material was necessary for the learning of 
higher-level raatcrial when cognitive hierarchies exist in the 
material. Airaslan (1969) reported that cognitive hierarchies 
could je reliably established through experts' agreements with 
regard to cognitive level. The Airaslan study suggested that 
subjects who missed a certain percentage of lower cognitive 
level items also missed a greater percentage of high-level 
cognitive items. The nature of these results suggest that 
hierarchies of cognitive compleKity e::ist and can be readily 
identified and validated. It is possible that student performances 
across these cognitive levels is fundamentally uniform and not 
necessarily a function of aptitude, perticularly in nastery learning. 

The primary objectives of the presert investigation were 
to examine the following hypotheses reoiardinn vaastery Instruction: 
(a) retention of achievement should exhibit decrements as a 
direct function of the length of the retention interval rather 
than as a function of scholastic aptitude, (b) variability of reten- 
tion scores as well as postlnstructlonal mastery sicores should be 
uniformly low as a consequence of the mastery Icarnln", strategy, 
and (c) students should perform uniformly across poaeinstructlon, and 
retention periods, regardless of the cognitive conplej^ity of 
the tasks or measured scholastic aptitude of the students. 
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Method 

Subjects 

Sixty-five students enrolled In a junior level educational 
psychology course participated in this study. These students 
were similar to the general collese population with respect to 
American College Test scores (mean ACT>21.9; S.D.«*3»2) and 
scholastic grade point average (mean GPA«»4.20; S.D.-.39). Of 
Che 65 S,s» all v/ere e<Iucation majoro and 50 were females* 
!Iaterials 

To assess student achievement, three parallel exams were 
designed and conatructect for each unit. These forms were considered 
criterion-referenced in that they (a) represented well defined 
achievement domains which were explicated through the use of 
instructional objectives and (b) contained a prespecified 
criterion level of 70% for the purpose of detenilnlnn mastery 
or non-mastery status for each S^. Objective type test items were 
written to represent these instructional objectives, and the 
items were then randomly assigned to each fouw. The mean item 
difficulty level for each unit across forms was ,589. Subsequent 
analysis confirmed the equivalency of forms with regard to Item 
difficulty, and internal consistency estimates for the terat forms 
ranged from ,79 to ,G9 with a median value of .85. 
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To investir.ate the connitlvts complexity of the test Items, 
three Instuctors of the course who were familiar tyith Bloom*8 
cognitive taxonomy (Bloom, 1956) were asked to classify each 
test item into one of two categories: low or hijjh cognitive, 
in which low cognitive questions were defined as 'knowledge 
level", (see Figure A) 

Place Figure A about here 

A high pwrcentage (88%) of interjudge concurrence was found 
between any pair of judges, and descrenancies in classification 
were resolved in conference. Consequently, two subscales were 
constructed for all unit tests utilized in this study. 
Procedure 

Each student enrolled in the course received a course 
syllabus explaining the conduct of the course and the underlying 
rationale of mastery learning! as well as a list of instuctional 
objectives prior to instruction of each unit. For each unit of 
instruction, S^s were administered one of the parallel forms 
preceding instruction; followinj^ instructlonj and durln'», a final 
examination period at the end of the school term. The retention 
test was unannounced and administered during the period normally 
used for instructional evaluation. Therefore, the results were 
interpreted as retention measures without the effects of reviet? 
or practice* Each S took the pre and post instructional mastery 
tests for each unit but was administered only one of three 
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retention tests. The retention tests were administered 
randomly to S,s by randomizing; the order in which they were 
distributed to the £s. 

l?or data analysis purposes, the independent variable of 
scholastic aptitude was defined as a linear combination of ACT 
scores and college CPA. Both measures have been V7idely 
accepted as indicators of how well students may be expected 
to do in traditional classroom settings. 

P. esults and Discussion 
All students involved in this study performed beyond the 
criterion level established as a consequence of the mastery 
learning strategy employed. When students failed to achieve the 
desired level of competency, prescriptive-remedial instruction 
was provided and re-tests were administered until mastery was 
demonstrated by all students. These results generally support 
the findings of previous studies (Airasian, 1967; Biehler, 1970) 
V7hich demonstrate mastery level achievement is attainable by most 
of the instructional population. 

Place Table 1 about here 

To investigate the first research hypothesis, a two-way 
analysis of variance with repeated measures on the first factor 
'.ma performed accordinc to procedures discussed in 'Jiner (1971). 
The results, shown in Table 1, indicate that differences of a 
major magnitude occurred for pre to post to retention periods 
for each of the units. Calculating the strength of association 
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for each of the units, eta -squares were uniformly high 
(.70, .67, .59), indicating a high degree of practical signifi- 
cance of the differences between ordered pairs in unit one using a 
Newraan-Kuels procedure, all differences were statistically significan 
at the .01 level. Thus, substantial gains were made as a result 
of learning for mastery. Retention was significantly higher 
than preinstruction levels but also significantly lower than 
the mastery level. For the four week retention interval, all 
possible pairs were statistically significant (p<.01) as in 
the case with uniu one. For the shortest retention period, in unit 
three, significant dlf .creuces •.;P<.01) were observed between 
preinstruction status and mastery status and betx/een preinstruction 
status and retention status. However, the differnce between 
mastery status and retention were non-aignlf icant (P>.05) for 
unit three. Therefore, it appears that retention does in fact 
relate directly with the length of the retention Interval. 

As a result of examining; the second aspect of the first 
hypothesis, that of the effects of aptitude upon retention, it 
must be noted that no statistical Interaction was observed between 
the repeated measure 'ire. pos":, retention) and that of aptitude. 
Since aptitude was a^rtlf Iclally dichotomized for the purposes of 
using the two-way jfapeated measures AilOVA, the relation between 
aptitude and achievement was also viewed in terms of regression. 
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Table 2 contains product-woment correlation coefficients computed 
between aptitude and scores for each of the three treatment 
conditions (prelns truction , postiustructlon , and retention) for 
the three instructional units studied. The results presented 

Place Table 2 about here 

in Tabel 2 indicate that only two correlations are sif»nificant 
and were based on the relationship between aptitude and pre- 
Instructional performance. From these data, and the results of 
the analyses of variance for total-test scores, it appears that 
aptitude as it is defined in this study is unrelated to both 
mastery and retention performance. 

It was further hypothesized that the mastery learning 
strategy reduces the variability of test scores since sufficient 
time is allowed for each student to attain mastery. Consequently, 
mastery-status teat score variance should be significantly smaller 
than preinstruction test score variance. In addition, retention 
scores should also eifhibit this reduced variance when learninj'. for 
mastery. The results, shown in Table 3, indicate that in unit one 

Place Table 3 a■^out here 

small changes in variance occurred from pre to post to retention 
Intervals. None of thene differences were statistically si;?niflcant 
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(ta3.17, df = 26, ?>,05). Ilovovcr, in unit t\70 a significant drop 
in tost score variance was observed bot'/oon proinstruction and 
postinstruction (?<.05). OdclXy onough» retention test score 
variancu increased dranaticaily, and the results ".jov^ statistically 
significant (t=4.5A, df=15j P<.05). In unit throe, a statistically 
significant variance increase xicis noted 'bctwcon nrc and post scores 
(t = 2.05, dfwlS, P<.025), althou{»h the changes fron post to 
retention were non-si-nif icant (P>.05) . Fron these results, it 
would appear that a single jjcneral conclusion can not be drawn 
about the variability of test scores from pre to nastery to reten- 
tion scores. Settin^i a criterion^ level and allowing students to 
study until mastery, has b.-.en achieved does reduce the test score 
variance when thes-^ scor.-s are obtained inmjdiately following the 
time that mastery has been dc-mons tratcd . However > the dissipation 
of learning as indicat^^d by decrotnents in the scores of retention 
tests docs not appear to be systematically related to any factors 
investigated in this study. In other words, the traditional 
predictors of colloce success, namely > GPA and ACT scores, are 
of little value when learning for mastery. 

Place Tabli.. A about here 

The results of th^ analyslrs of variance for the hij'.h and low 
cognitive scales are shown in Table A. Cell and marginal means, 
as well as the standard deviations for low and hi^h cognitive scales 
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arc presented In Table 5. Although thrcu judges familiar 
with Bloon's taxonomy concurred 38% of the time in the classification 
of test items uith regard to cognitive complej:ity> the correlations 
observed bctv;oon these two scales across different tiiV;o intervals 

Place Table 5 about here 

ranged from -.13 to .62. Part of the typically Iot; relationship 
can be attributed to the narrow range of student performance within 
the levels examined, (pro;, post^, retention), particularly under the 
mastery level. However, the uniformly low and larr^ely non-sisnif ican 
correlations reported above r.mst lead to the conclusion that 
the two sub-scales represent relatively independent cof>nitive 
dimensions • 

From the AilOVA results reported in Table 4, only main effects 
differences over time werj statistically significant (P<.001). 
As in the instance of the full scale testS;, the strength of 
association^ the correlations, r;ero. uniformly large* In no instance 
were the main effects tests for aptitude significant (P>#05) 
and only one of three interactions was significant. The significant 
interaction in unit three (?<.05) accounted for only nine per cent 
of the criterion variance andj, ^^s a consequence, vras not interpreted 
as having practical significance. To more aptly describe the 
relation between aptitutdo and the low and high cognitive scales, 
correlations v;ere computed and are reported in the first two 
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columns of Tablo 2. Only throe of the 18 correlations woro 
significant beyond the ,05 level, and all thrco sicnificant 
coefficients occurred under prainstructional conditions. Therefore, 
it appears that aptitudu does operate in determinins preinatructlonsl 
status but has little infiiienc... on initial laarninp. and retention 
status for either the low or hijjh cosnitivo tnsks. 

Generally, the results of the present invosti}»ation are 
construed to support some of the basic assumotions of both Carroll 
and Bloom regarding mastery learning. ITamely, that f^ivcn enough 
time students will learn to a unifortnly high level of proficiency 
regardless of aptitutdj for learnin-?, and that aptitude plays 
a relatively minor role in determining the degree to which one 
learns and retains instructional material. Furthermore, regardless 
of the cognitive complexity of the task students perform uniformly 
when Icarnins for mastery as is suggested :'.n prcviou-? research 
(Airasian, 1969) . The authors express reservation with regard 
to the applicability of theou conclusions to the general school 
population, other than a college population. There are major 
differences between colltif^j upperclassuen and either elementary 
or high school students, not the least of which is the wider range 
of abilities and motivation, plus developriental phenomenon, which 
may be emerging in youngi^r persons and Interacting with scholastic 
achievement. Yet, the results appear to be quite definitive with 
regard to the performance of university students under the mastery 
learning strategy, and further systematic analyses of student 
performance in other suject domains would be of interest. In 
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this study, .ho content of units one and thrcci wore quite 
different from unit two (statistical concvjpts) , and tluj rusults 
differed slightly with r^spoct to the aptituda-achievonont 
relationship for unit two, Tha hif^her correlations between aptitud 
and achievement for unit three, as well as the rolativoly hif»h mean 
test score for unit three under nreinstruction conditions, suf»j»ast 
that aptitude may facilitate transfer o£ general academic skills 
such as adapting to new material and specific instructional 
sequences. This is to say, students with hi^^hor aptitude scores 
are more uffiocicnt in benefiting; from an instructional experience 
and transferring netr skills to new learnin?: tasks. When unit throe 
V xams aru administered at the beginning of the course however, 
scores were observed near the chance level indicatinp, little or 
no entering knowledge in the content area. 
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Exarcples ot teat itcMu itou Chd Low und HlQh GoQnltive Subscaloa 

X Lqvi«1ovo1 Cognitivo toat itomi 

!• The inost important dinglo quostlon which ahould bo raised rogardins any 
psychological tost concorno its: 

A. Validity 
Bt Reliability 
Ct Content 
Dt Objectivity 
£• Standardisation 

2« In Bloon*s Taxanouiy "synthesis" is defined as the: 

^ At Combining o£ elements into a new product 
Bt Applications of standards of acceptability 

C« Translation of verbal message into aocoe other appropriate symbolic 
fonn 

Dt Sorting of the whole into its component parts 

XI High-level Cognitive test items: 

It tThich of the following teachers 'statements indicates the best understanding 
of the teachers* responsibility? 

At "Test results showed that my test was too easy*" 
^ Bt "I am pleased that students did well on the test;" 

Ct "Scores on my test averaged at the $0 percent level of difficulty« 

so it was a good test*" 
Ot "I^ students could not anticipate the g«M7al nature of the test 

questions^ so it was a good test*" 
Ut "Test results shov^ed that iny test was too hardt" 

2« Measurement is related to evaluation as 

At specific to general 

Bt concrete to abstract 

Ct Sufficient to necessary 

#«# Ut means to end 



TABL6 1 



8Kr copy 



F*rati0Sf appropriate probability atateraonts^ and correlation ratios for t«on;ay 
analysis of variance for Units Onei TW0| and Three 





Unft 1 


df 


t 


n8 


A (Trenttnent) 




125*1 


.70 


B (Aptitude) 


2,25 


.6 


m 


A X B 




1.7 


m 


Unit 2 


A* (Treatrncnt) 


2.28 


75.0 


.67 


B« (Aptitude) 


2,l6 


0.0 


mm 


A»x B 


4,26 


X.3 


m 


Unit 1 


A (Treatnent) 








B (Aptitude) 


2,17 


1«56 


mm 


A X B 




1*2 


mm 



^ p^•ool 
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Correlations between Aptitude oncl Achievonwnt at Pre">Inatruction| Post Instruction 
and Retention Levels 





Unit One Nb26 


High Cognitive 
Achievement 


Low Cognitive 
Achievement 


Full Scale 
^cl^ievement 


Prc-Instruction 


.15 


.50** 


45* 


Po8t»Instruction 


-.25 


«.l6 


-.09 


Retention 


-.03 


-.03 


-.10 


Unit T\;o N"17 


Pre-Instruction 


-.03 




-.22 


Post -Inst ruction 


.16 


.25 


.'fl89 


Retention 


.26 


.01 


.15 


Unit Three M<b20 


Pre- Inst ruction 


,53** 




^9#* 


Poot-Instruction 


.28 


,0h 


.11 


Retention 


.17 


.04 


.11 



* PA.05 

** Pi. ,01 



Cell and tlarfiinal Heans and Standard DovlaClons for Che Ti70 Way Attalysis of 
Variance with Repeated Measured on One Way for Units One> TwO| and Three* 



ADtitude 


Preolnatruction 


Post" Ins cruet ion 


Retention 






r^an 




mean 


a.d. 


fnean 


Oodi 


mean 


High 




7.6 


71 


0.1 
jr.* 


63 


4.7 


60 


Average 






MS 

72 


5.6 






57 


mww 


kl 


6.0 


72 


7.8 


65 


6a 


59 


Total 






72 








58.7 


Unit Tv;o 
















High 










6U 




57 


Middle 


kl 


6.0 


73 


3.3 


59 


9.9 


58 


Low 


kl 


10.4 


70 


7.7 


59 


6.3 


57 


Total 


36 




72 








57.3 


Unit Throe 
















High 


58 


6.6 


76 


6.2 


77 


11.0 


70 


Middle 


55 


8.5 


71 




7^* 


5.7 


67 


Lev; 




10.6 


70 


u.d 


76 


7.5 


67 


Total 






7^* 




76 
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P«ratloa, appropriate probability atatetnents, and corrolation ratios for two-way 
analysis of variance with repeated ivwasure on one factor for the high and low 
cognitive scales Unit one, ^;o, and Three 



Uniu One , , 


df 


Uigh Cognitive 
P n 


Low Cognitive 
df P n 


V (Treatment) 


2,50 


68.5** .71 


62.3** .61 


6 ( .ptitude) 


2,85 


0.9 


1.2 


A X B 


U.50 


l.O 


1.9 


Unit Two ■ ■ -■ 


A (Treatment) 


2,28 


92.3** .76 


20.5** .3^ 


B (Aptitude) 


2,11^ 


0.3 


0.0 


A X B 


1^,26 


0.8 


X.l 




A (Treatment) 




25.*+** .39 


38.3** .55 


B (Aptitude) 


2,17 


.2.63 


0.2 


A X B 




2.79* .09 


1.2 



* Pii..05 
** PZ.Ol 
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